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COMPUTER-AIDED GROUP-LEARNING In order for group discussion environments to be 

METHODS AND SYSTEMS effective, the group should not be too big because a big 

_ group discourages interaction. However, a small group can 

This application is a continuation of US^patent appli- end up gossiping, wasting a lot of their time. An ther 

canon Ser. No. 09/01 .653 filed on Jan ,29 1998. now US. 5 problem of a ^ % ^ members have Uinited 

Silica°tion ,S lDCOrP ° y CC ,W ° *" «■*"■«« One benefit f a classroom nvironment is the 

pp presence of an instructor, who presumably should have 

BACKGROUND OF THE INVENTION much more knowledge in the subject of interest than the 

The present invention relates generally to learning, and f*"* 51 " 5 * A &™p environment does not have that luxury, 
more particularly to computer-aided methods and systems 10 1116 nu ^ bt & el sluck m a certain critical area, and 
for a group of users to work on a subject cannot proceed. Also, members mighl have diverse strengths 

The most common group-learning environment is a class- ^ weakness One member of the group might be much 
room. For thousands of years, knowledge has been conveyed Weaker T" ott ft He nught * left bv me remain * 

in a classroom, with an instructor teaching a group of , 5 "* members of ** S™ 1 *' and ^timately drop out of the 
students. Such a group-learning environment has many &° U P* 

benefits. For example, some students may be too timid to ask Another environment to learn that is becoming more 
questions, though they do not understand. Such students will prevalent is learning through computers, which are gradu- 
benefit from others who are not afraid to ask. When the doming an integral part of our culture. It is not 

instructor answers a question, many students benefit While , ^cu* 1 10 include fancy audio-visual effects in the instruc- 
some students learn from the answer, others are encouraged 20 malerials - Such multimedia computer-aided learning 
they are not the only one who do not understand. There systems can help some of us focus because they can create 
might even be students feeling superior over the student a . Io! of slimul j t0 our senses. Another benefit of computer- 
asking the question because they know the answer. Though a *^ e< * leanin S is the immense amount of information avail- 
such feelings should not be supported, they may motivate aWe *° ^ users - Not onlv do the users have access to 
some students to learn. These types of psychological advan- 25 barddisks wi * giga-bytes of information, they can surf the 
tages of a group-learning environment should not be under- Internet and the World-Wide-Web for practically unlimited 
estimated. resources. 

However, typically, there are too many students in a class. Manv computer-aided learning systems that are tailored to 
It is not uncommon to have students day-dreaming or even ^ *® °f individual students are also in development, 
sleeping in class. The instructor just cannot cater to the needs Sucn me *ods and systems have been illustrated, for 
of each student. Also, students in a class room are passive example, in the following allowed U.S. patent applications: 
learners. They usually do not interact among themselves 1- Methods and Apparatus to Assess and Enhance a 
during class because information should flow from the Smdent's Underetanding in a Subject, with Ser. No. 08/618, 
instructor to the students, not among the students. With the 35 193; 

instructor being the center of attention, students interacting 2. A Reward Enriched Learning System and Method, with 
among themselves may be considered as interrupting the Ser. No. 08/633,582; 

instructor and disrupting the classroom atmosphere; those 3. A Relationship-Based Computer-Aided-Educational 

students might be reprimanded. Actually, there are instruc- System, with Ser. No. 08/664,023; and 

tors who do not even . allow questions from the students. „ 4. A Learning System and Method Based on Review, with 

Another learning environment is a small group of students Ser No 08/675 391 
actively interacting. A student who does not understand a These systems and methods are quite intelligent, and very 
ceruunareacanbeasststedbyanotherstudenL Withstudents ^ They identify> ^ offer JJL* to, one 

interacting, encouraging and even crincizing each other. of the main weaknesses of classroom education-an instruc! 
diey are more alert than students in a typical classroom. 4S tor cannot cater to the needs of each student. By focusing on 
Such an active mteractmg envuonment is more stimulating me strengths and weaknesses of individual students, 
than the passive learning envuonment of a classroom. computer-aided learning systems can effectively teach. 

Not only do students m such an active environment have evaluate and reward users, 
better concentration, they typically have better understand- However, inherent in such computer-aided learning sys- 
uig of a subject than the passive classroom students. By so terns and methods is the unavoidable effect of working 
getting more involved, the students develop more insights in solely with a machine, not a living being. Until one day we 
die subject. Also, no one person has exactly the same have machines with artificial intelligence that is as sophis- 
background and experience as another. During interaction, Seated as a human mind, working with machines typically 
different students bring into the group different perspective. is not as interesting as interacting with another human being, 
which can be enlightening. J5 Even then, we might still prefer to interact with our peers. To 

A similar discussion environment with a lot of interaction be ridiculed by our peers might generate more 
is a chat room in the computer world. Members of a chat consequences— not necessarily productive— than to receive 
room typically share a common interest; it can be breast accolades from our computers. We usually prefer to have a 
feeding a baby or biology. Usually, there is an initiator, who certain degree of human touch. 

starts a session of discussion in a certain area within the 60 It should have been obvious that there is a need for a 
common interest Other members of that group respond. It is computer-aided learning environment for a group of users, 
an environment where information is exchanged freely, in where they can interact and work on a subject together, 
un -controlled discussions. Typically, the sessi n nds when 

members lose interest Though interesting, such chat room SUMMARY OF THE INVENTION 

environments are not geared towards learning. It is m re 65 The present inventi n provides methods and systems f r 
suitable f r a group of members with similar interest to a computer-aided group-teaming environment, where a 
express then viewpoints, or exchange ideas. number of users can interact and work n a subject together. 
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Not only can the invention include benefits of a person- generated for the users, and the way to present the materials 

alized computer-aided learning system, such as learning to each of them. Th recommendation generator can also 

materials tailored to users and large databases of produce information regarding each user's performance on 

information, the invention can also allow users to interact. A the subject, and the effectiveness of the embodiment. It also 

user working in such a group-learning environment is usu- 5 can suggest what materials each user should individually 

ally much more alert than w rking individually with a w rk on. 

machine. Also, typically, it is more effective to solve a The report generator can generate reports, such as on each 

problem by a group than by a single person. Not only do user's performance to show what each user should be 

different users bring into the group their different working on. The reports can also show each user's progress 

background, experience, knowledge and perspective, a io 3X1(1 * e embodiment's effectiveness in helping users work 

group environment can help users concentrate. on ^ ^j^t 

In one embodiment, the invented system can monitor and Another embodiment °[ invention further includes a 

analyze users' inputs, such as when they are interacting. TTiis wh ^ ^ts the users who can use the 

^k^. ABt JZ^c th* n^nrini ™t*«n „f JLJT! embodiment to work on the subject The registry can receive 

embodiment reduces die potential pitfall of users wasting potendal ^ characteristics to determine whether such 

too muchume gossiping or distracted from the subject of 15 ^ ^ join e work e ^£ 

interest because die system can be aware of such distrac- subject ^ ^termination may be by an instructor, the 

tions Also a weak user can be identified early on so that he embodiment itself, or the existing users. The registry can 

can be separately taught to bnng him up to speed with the also access a summarized profile of the existing users to help 

other users. Such a weak user might be more motivated to the potential user decide if she wants to join. To further 

learn in a group environment than in an individual learning *> enhance the decision process, the registry can also provide 

environment because he might be ridiculed or ignored by the potential user temporary access to a dialogue session to 

other users due to his ignorance. communicate with the existing users. Moreover, the registry 

In another embodiment, the analysis process is not limited can fort » d an existing user from using the system to work on 

to identifying a user's performance in working on the * e subject, based on recommendations, such as from an 

subject, it is also applicable to understanding some of her 25 "Kiroctor or other users, or due to the user's consistently 

traits, such as confidence level, and whether or not she has P°° r Performance in working on the subject, 

a good learning attitude. * n vet another embodiment, the invention includes a 

One embodiment of the invention includes an interaction T r ' prof ! ,e St0rag * medium, which stores each user's 

controller, which generates materials on the subject for the such as his performance m working on the 

users, and sets a duration of time for the users to commu- 30 fiR? d * ™K J? - ?* ''SF^f °/^f 

nicate in a dialogue environment "JJ * Z * ^ ad J ,UOn ' " *? 

p_ . * . . _ m users commumcation can be individually stored, and 

To be aware of an end in a dialogue session helps the accessed 

group focus, because if there is no end in sight, there is a Another embodiment of the invention includes a notepad 

higher tendency for users to wander aimlessly In one 35 for a user l0 ^ notes ^ ^ can m fgMtM$ 

embodiment, the mteraction controUer initiates and stops a by ^ ^ te ^ t0 ^ ^ hecdn]i nk*n area 

dialogue session for users to communicate among them- ^ ^ notes l0 a ^ ^ ^ mate F rials ^ ^ fh)m ^ 

selves for the duration of time embodiment, and bookmark certain parts of the materials for 

In one embodiment, materials generated for the users can his notes. The interaction controUer can also guide the user 

be individually tailored to each user, who can access the ^ t0 take notes. This can be done, for example, by generating 

materials separately from the other users. The interaction a summary of the materials for him; the summary can be in 

controUer can also generate questions and tests to determine a topic format The amount of details in the summary can 

users' performance in working on the subject, and provide depend on the user's performance in the subject, or can 

hints to help users solve problems. depend on ^ overall performance of aU of the users. The 

Working on the subject in a group and working alone can 45 interaction controUer can also highUght sections of the 
be intertwined. For example, die interaction controUer can materials that the user should take notes, where the high- 
generate materials on the subject for every user individually, Ughted portion can depend on the user's performance. The 
and then select a problem for the users to solve. Hie users use of this notepad is not limited to a group-learning 
first work on the materials generated individuaUy, and then environment; it can be used by a user studying alone, 
solve the problem together in a dialogue environment for a 50 Other aspects and advantages of the present invention wiU 
duration of time. During the dialogue session^ the mteraction become apparent from the foUowing detaUed description, 
controUer can provide hints to the users. After the duration which, when taken in conjunction with the accompanying 
of time, or before, if the users have resolved the problem drawings, Ulustrates by way of example the principles of the 
sooner, the mteraction controUer can generate additional invention, 
materials on the subject for the users. „ 

In one embodiment, the system also includes an BRIEF DESCRIPTION OF THE DRAWINGS 

initializer, a performance analyzer, a recommendation PIG. 1 shows one embodiment illustrating the present 

generator, and a report generator. The initializer aUows a invention. 

user, such as an instructor, to set the subject to be learnt The FIG. 2 shows one mbodiment of a number of functions 

performance analyzer analyzes users' inputs to determine 60 performed by the interacti n controller f the present inven- 

their performance, and attitudes, such as their participation tion. 

levels and modes of participati n in the dialogue sessions. FIG. 3 shows ne mbodiment of a user interface for a 

The performance analyzer also can generate a summary of user to indicate selections to the communication controUer 

the users* performance to be stored for later retrieval. in the present invention. 

Based n utputs from the analyzer, the recommendation 65 FIG. 4 shows one embodiment of examples of functions 

generator produces recommendations, which can be used by performed by the performance analyzer of the present inven- 

the interaction controller t determine the mntwijite to be tion. 
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FIG. 5 shows one embodiment of examples f recom- above embodiments can be mixed and matched. For 
mendations provided by the rec mmendadon generat r of example, one interactive device might include a keyboard, a 
the present invention. monitor and a video camera. 

FIGS. 6A-B show a physical implementation for one In one embodiment, the interactive device is for the visual 
embodiment of the present invention. 5 impaired, and includes speakers. In another embodiment the 

FIG. 7 shows one embodiment of one set f process to interactive device is for the hearing impaired, and does not 
work on a subject for the present invention. include speakers. 

FIG. 8 shows one embodiment of some of the functions HG. 2 shows one embodiment of a number of functions 
performed by the user registry of the present invention. 1Q Performed by the interaction controller. For example, the 

FIG. 9 shows one embodiment of some of the functions infraction controller generates for the users materials, 
performed by the user-profile storage medium of the present wmch can 

invention. learning materials 150 on the subject which can be 

FIG. 10 shows one embodiment of some of the functions tailored 158 to a user, 

performed by the notepad of the present invention. 15 M answcr 152 10 a <l uestion ft™ 0 a user- 

Same numerals in FIGS. 1-10 are assigned to similar a lest 154 for one or more md 
elements in all the figures. Embodiments of the invention are outputs to guide 156 users' dialogue, such as to warn a 
discussed below with reference to FIGS. 1-10. However, disruptive user, or a message to a user who has been 

those skilled in the art will readily appreciate that the commurocating in areas unrelated to the subject for a 

detailed description given herein with respect to these fig- 20 predetermined duration of time, 
ures is for explanatory purposes as the invention extends to one embodiment materials can be previously stored in the 
beyond these limited embodiments. storage medium 120. To generate the appropriate materials, 

the interaction controller can access them from the medium 
DETAILED DESCRIPTION OF THE and mav assemble the materials into a format suitable 

INVENTION 25 for the users. 

- . ... In one embodiment the interaction controller also mom- 

FIG. 1 shows a learning system 100 to illustrate one tors 160 inputs from the users into the system, which can be: 
embodiment of the present invention for users to work on a the users' dialogue 16Z 
subject together. It includes a number of elements. For t h» 11C<W - ^e™* t * A . . u • . 
example, an initializer 102 initializes the system 100. such % TZZT^T , ^ C ° n ^ such 

as by setting the subject; an interaction controUer 104 30 * e ^ 10 ^ nom *«* ** mter * 

generates materials for the users to work on the subject and » u """rouer, 

monitors the users* responses; a number of client commu- "* approac ^ es a user f 10 m P ut malerials the 

nication controllers, 106 and 108, take care of communica- ? ySlem; . e * wn l*' amount of time the user 

tion at the users' side; a number of interactive devices, 110 , c mteracts m . a the frequency 166 and 

and 112, serve as the input/output devices delivering mate- P *"?™ ° f In . teracd0n - such 35 rae durati ™ of time of 

rials to and transmitting materials from the users; a perfor- each ^ction, and the time gap between two inter- 

mance analyzer 114 analyzes the users* responses monitored acGons; ? umbeis of ( J uesnons te »» ^ksd the 

by the interaction controller 104; based on the analyses, a Syslem ' anoth ^ 30(1 ^ users; number of 

recommendation generator 116 generates recommendations ^ stateme ^ made; and the number of responses to 
to direct the interaction controller, such as recommending 40 . queSt T by ** 10 
the materials to be generated; a report generator 118 gene* ^ general, a chentcommumcadon controUer takes care of 
ates reports: and a subject material storage medium 120 1°™*™*™*°* at a user end In one embodiment when a 
stores the materials on the subject ?* , wam ? t0 transimt information to a second user, the 

- . . . .. . M . . . . mM first user's client communication controller is responsible 

^LT^-J^ n T ™^' Sy ? m 1W ' ^- 25 by 45 for laying information from its conesponding inactive 
SSX* L rt r Hf"- 11 ^ en * od, « device to the interaction controller, whicbcan then relay the 

uuuaUy. the system can be used for many subjects. An information to the second user s client communication con- 
structor with his password can access the mmatizer to troUer. In this embodiment, client communication control- 
ift! k ^ f ^^ n *° ^ another embodiment, the uutializer lers are no , directly coupled to each other, but can couple 
102, by default, automatically selects a speofic subject 50 through the interaction controUer. 

Each user accesses the system through an interactive Note that in this embodiment, the interaction controUer 
device, which provides outputs to the user, and which can restrict, 168, one user from communicating with another 
receives inputs from the user. Different embodiments are user, such as by not transmitting messages between the 
appUcable for the interactive device. In one embodiment, the users. TypicaUy, the relaying has to propagate through a 
interactive devices are monitors and keyboards, aUowing 55 communication medium, such as a network. At the receiving 
users to enter their inputs through keyboards, and receive end, the client communication controUer can interpret infor- 
utputs on the monitors. The interactive devices can include matron from the interaction controUer, which might have 
digitizing boards to aUow free-hand or graphic input. In received the infonnation from another diem c mmunicati n 
another embodiment, the mteracuv devices include micro- controUer. Interpretation can include formatting the received 
phones and speakers t all w oral communication. Based on 60 infonnation for the appropriate interactive device to present 
speech recognition hardware and software, which can be the information. 

located in the interacti n controU r r the interactive man ther embodiment, client communication controllers 
devices, the communication can be converted to digital are directly coupled, as shown by the dotted line in FIG. 1 
signals and interpreted. In yet another embodiment, the In mis embodiment, if information is from a user s interac- 
lnteractive devices include video cam ras to aUow users n t 65 tive device, the corresponding client communicati n con- 
only to be heard, but also to be seen, which might just troDer first decides whether the information is for another 
include users' faces shown as icons on a pan of a screen. The user, or for the interaction controUer. If it is for an ther user. 
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the controller will send the information t the c responding the communication modes for recipients of materials from 

client communication controller of that user. Typically, the system. In other words, the interaction controller can 

information is als sent t the interaction controller to be decide if ne or more users should receive materials from the 

monitored. If the interaction controller wants t restrict system. 

communication between rw users, the interaction controller 5 Another embodiment includes another mode of commu- 
can send such a restriction c mmand t the two correspond- nicdxi n known as a uni-directional mode. If the interaction 
ing client communication controllers. They can break the controller sets an interactive device through its client corn- 
specific communication link between them. Similarly, if munication controller to be in such a mode, information will 
information is from the interaction controller or from f* ow to that device, but not from that device to any other 
another user's communication controller, the client commu- 10 interactive devices. Inputs from that device can be received 
nication controller is also responsible for interpreting those ^ monitored by the interaction controller, but not by other 
information, in ways, for example, as discussed above. users. In other words, information flows uni-directionally. 

In one embodiment, a user can decide the format to To implement the different modes of communication, in 
receive information. The user can, for example, transmit his embodiment where the client communication controllers 
desire through its interactive device to its communication 15 ^ not directly coupled together, the interaction controller 
controller. FIG. 3 shows one embodiment 200 of a user maintains a separate communication session for each corn- 
interface for the user to indicate his selections to the com- munication controller. When the interaction controller sends 
munication controller. That embodiment includes a monitor information to users: 

screen with a number of dialogue boxes at the bottom of the In a unicast mode, through a communication session, 

screen, and with one box designated for the format 202 of 20 information is sent to a communication controller; 

the information. In a multicast mode, through the communication sessions 

In one embodiment, the interaction controller is config- of a number of users, information is sent to those 

ured to allow the materials to be presented to the users in one communication controllers; and 

or more formats 170. For example, the formats can be visual. In a broadcast mode, information is sent through all of the 

as in text and pictures, or audio, as in speech, or audio- 25 communication sessions to all of the communication 

visual. The different formats can be mixed and matched, controllers, and this can be done one at a time, 

such as information with pictures and text can have the text Similarly, if information flows from an interactive device, 

presented orally, and pictures visually. A user can select one the information can first be sent to the interaction controller, 

or more output formats to receive the materials by activating The destination of the unicast mode depends on whether 
the format dialogue box 202, which will allow the user to 30 another user is the recipient, or whether the interaction 

pick the preferred format. The default mode is text and controller is the recipient. If another user is the recipient, the 

pictures. interaction controller forwards the information to the des- 

In another embodiment, the materials for a user are lined user. However, if only the interaction controller is the 

presented in more than one format, and the user can select recipient, the controller does not forward the information to 
the sequence to receive materials in each format, again 35 any user. In the multicast mode, the controller forwards the 

through the format dialogue box. If materials are in text and message to the group of designated users. In the broadcast 

pictures, and if the user's interactive device has a slow mode, the controller forwards the information to all of the 

connection — which can be due to the speed of the interactive sessions. 

device, or the connection between the communication con- To implement the different communication modes in an 
troller and the interaction controUer— the user can select the 40 embodiment where the communication controllers are 
output format so that text is transferred first. Then, while he directly coupled, the interaction controller can set up a 
is reading the transferred text, pictures are slowly displayed point-to-multipoint (PMP) connection from each communi- 
n his monitor. cation controller to each of the other communication con- 
Information going to or coming from one interactive trailers. The interaction controller can also set up an indi- 
devicedoes not have to show up in all of the other interactive 45 vidual communication session with each of the 
devices. Different modes of communication can be set. For communication controllers. In this embodiment, if the inter- 
example, each user can determine the one or more recipients action controller wants a communication controller to oper- 
of his communication. If he only wants the system to receive ate in the unidirectional mode, the interaction controller will 
his message, he can set his communication mode to a unicast either not set up, or remove the already established, com- 
mode—the mode where his communication goes to either 50 munication controller's PMP connection; that controller can 
the system, or the system with one user, which again is up only receive information, but cannot transmit information to 
to him to select If he does not want all of the users to receive other communication controllers, 
his communication, he can set his communication mode to In one embodiment, each piece of information contains an 
a multicast mode— the mode where his communication only indicator indicating its destination. If information flows 
goes to a number of destinations, but not all. However, if he 55 from the controller to one user in the unicast mode, the 
wants everyone to receive his communication, he can set his indicator indicates only one user, in the multicast mode, the 
communication mode to a broadcast mode. indicator indicates the intended users: and in the broadcast 
In one embodiment, a dial g box in FIG. 3 is labeled as mode, the indicator indicates all of the users. Similarly, for 
Communication mode 204. If activated, the user will be inf rmation from a user, there will be an indicator in the 
given the following three choices: unicast, multicast and 60 message indicating the recipient Note that in the broadcast 
broadcast mode. If the user selects the unicast or the mode, the original sender of the informati n does not receive 
multicast mode, he will be given the names or pictures fthe the message. 

other users, and the interaction controller. He can then select Hie interaction controller directs dialogue sessions, such 

the recipients of his message. Unless restricted otherwise, as when to start and when to stop such sessions for inter- 

the mteractj n controller receives his message. 65 action. This dialogue time period can depend n a number f 

In one embodiment, just as users can control the recipients factors, for example, the number of users and the issues to 

of their messages, the interaction controller can select 172 be addressed by the users. In the default mode, the time 
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period is set t be fifteen minutes. In one embodiment, this 
period is set by a number of rules. Typically, the m re 
complex the issues, the longer the time period. However, the 
interned n controller can take other factors into consider- 
ati n. For example, the rime period will be ten minutes if 
there are two users; and the time period will be fifteen 
minutes if there are four users. In yet another embodiment, 
the interaction controller sends a message to each user when 
the session is going to be over soon; for example, if the 
designated session is a fifteen-minutes session, then one 
minute before the end of the session, the interaction con- 
troller will tell the users to wind down because the session 
is going to end in one minute. In one embodiment, each 
interactive device has a counter, which shows the amount of 
time left in the dialogue session, as the users are interacting 
in the session. 

When the interaction controller determines that the users 
should spend some time on an area of the subject in a 
dialogue environment, the interaction controller will start a 
dialogue session. There are a number of factors to consider 
when to have a dialogue session. Typically, after receiving 
materials from the interaction controller for a period of time, 
such as twenty minutes, the users might prefer to be 
involved in a dialogue session. Mixing and matching work- 
ing on a subject by oneself and working with others can 
enhance concentration and comprehension level. There are 
other reasons to mix and match such different learning 
environments. For example, after the interaction controller 
has presented a concept, sometimes, it is beneficial for the 
users to discuss the concept together, or to work on a 
problem based on the concept. Such interaction can 
strengthen understanding and help users better remember 
what they have learn. In yet another example, it is sometimes 
beneficial for users to start learning a subject by discussing 
issues or trying to resolve a problem in the subject In this 35 
example, users start working on the subject with a dialogue 
session. Designing such learning process— intertwining 
individual learning and group learning environments- 
should be obvious to those skilled in the art 

In one embodiment, to start a session, the controller sends 
a message to each of the users, telling them to start working 
on the area. Note that in the embodiment where users can 
interact among themselves without going through the inter- 
action controller— the embodiment as shown by the dotted 
line connection in FIG. 1 — the point-to-multipoint connec- 45 
ti ns for each of the communication controller to the other 
communication controllers should already be in place. With 
the initiation from the interaction controller, the users can 
stan working on the area together. As will be discussed, the 
interaction controller can start the session by posing a 50 
question for them to answer. 

After the fixed period of rime of interaction, or sooner, if 
the users have accomplished their designated mission earlier 
than scheduled, the interaction controller will terminate the 
discussion. This can be done by sending a message to each 55 
f the users indicating to them that the discussion is over. In 
one embodiment, if two users continue on discussing, the 
interaction controller can send them individual messages 
asking them t stop; r the interaction c ntroller can restrict 
the communication between them in ways as discussed 
above. 

During the dialogue session, the users can communicate 
through their interactive devices. For example, a user's 
inputs through his keyboard can be seen in another user's 
screen, or a user's voice can be heard in another user's 
speaker. Users can communicate in different modes, for 
example, in the unicast, multicast and broadcast mode. 
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Users can exchange, for example, c nversation through a 
microphone; text through keyboard inputs; drawings 
through a drawing utility, such as a pointing device r a 
digitizing board; and video images or non-verbal c mmu- 
mcation through a digital camera, or motion detecting 
devices. 

In one embodiment one user can passively observe inputs 
from other users, but other users cannot receive her com- 
munication. She is in the uni-directional mode of commu- 
nication. She can be an instructor observing other users* 
progress in working on the subject 

If users input through voices, their voices can be digitized 
and interpreted through speech recognition mechanisms. If 
the inputs are through pictures, they can be analyzed and 
interpreted by image recognition hardware and software to 
15 identify different features. For example, one user is falling 
asleep if his eyes are closed and his head is pointing 
downwards for more than five seconds. In one embodiment 
voice and image recognition can be performed in the inter- 
active devices. This will reduce the amount of data traffic 
20 from the interactive devices to the interaction controller. In 
another embodiment such recognition can be done at the 
interaction controller or the performance analyzer. 

In one embodiment the performance analyzer 114 ana- 
lyzes the monitored users* inputs, which can determine 
25 users* performance on the subject, and users* characteristics. 
FIG. 4 shows one embodiment of examples of functions 
performed by the performance analyzer 114. For example, 
the analyzer 114 can analyze a user's performance on the 
subject 225, his input frequency 227, his participation in 
dialogue sessions 229, and the relevancy of his inputs 231. 
Note that a user's inputs are not limited to his inputs during 
dialogue sessions because the user can input such as ask 
questions, when materials on the subject are presented to 
him. 

In determining a user's performance 225 on the subject 
the performance analyzer can analyze the tests administered 
to the users, or the answers to questions presented to the 
users. Results from the analysis can determine the users* 
performance in working on the subject There are many 
ways to generate tests and questions of varying scopes of 
40 difficulties, and to analyze their answers. Some have been 
taught in the allowed patent application, entitled. Methods 
and Apparatus to Assess and Enhance a Student's Under- 
standing in a Subject with Sen No. 08/618,193, which is 
hereby incorporated by reference into this specification. 

Hie analysis can be rule-based, where the rules can 
tetermine users' characteristics. Certain inputs by a user 
imply the user has certain characteristics. 
Examples of such rules include: 
A user interacts infrequently if he interacts less than 25% 
of an average user, which can be the average user of the 
group, or the average user among a number of groups 
using the present invention. 
If a user interacts infrequently, the user is working on the 

subject passively. 
A user interacts frequently if the user interacts more than 

150% of an average user. 
A user who is below the 15 percentile of the group in 

performance is very weak in the subject 
A user who is above the 85 percentile of the group in 

performance is very good in the subject 
If a user's mputs in a dial gue session have less than 25% 
relevancy to the subject, the user is not conducting a 
normal interaction. 
If a user is not conducting a normal interaction and the 
user interacts frequently in a dialogue session, the user 
is disrupting, 233, the group during the dialogue ses- 
sion. 
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If a user often disrupts dialogue sessions, the user may not In the above embodiments, for clarity, names are given to 
be a team player. different elements to perform different tasks. However, it 

A user dominates, 235, a dialogue session if the user sh uld be understood that the numerous tasks can be per- 
interacts more than 300% of an average user of the f rmed by other elements. For example, the perf rmance 

5 analyzer can also generate recommendation, and reports. 
If a user dominates a dialogue session, the user may have FIG. 6A shows one embodiment of physical implemen- 
leadership characteristics. ration 250 of the invention, preferably in software and 

If the group's inputs in a dialogue session have less than hardware. The embodiment 250 includes a server computer 
25% relevancy to the subject, the group has been 252 and a number of client computers, such as 254, which 
distracted from the subject 10 can be a personal computer. Each client computer commu- 

The recommendation generator 110, based on the ana- nicates to the server computer 252 through a dedicated 
lyzedi results, provides recommendations FIG. 5 shows one communication link, such as an intranet, or a computer 
embodiment of examples of recommendanon provided by ne rwork 256, which can the Internet, the Web or other forms 
the generator. The recommendation can be for the interac- Q f networks, 
tion controller 102 to determine the materials to generate. 15 mr* jtd l . ~ * 

240, for the users. In one embodiment, the recornrrfnS !t ™.' ® Sh °7 ? e ™*>^™ ° f a <* en < c ™puter 254. 
can be for the interaction controller 102 to determine tSe * lyp,CaUy a bus 259 connectu * a number of 

way to communicate, 242, to a user. The recommendation 2? p0 ™ SUCh " a pr0Cessing unil 260 ' a main memorv 
can also be used for generating reports on a user's progress. \™ 1/0 controller 264 - a peripheral controller 266, a 
Again, the recommendation generator can be rule-based, and 20 &*P hlcs ada P ter 268 * * circuit board ISO and a network 
it can apply some of the rules of the performance analyzer. interface ^P^ T 270. The I/O controller 264 is connected to 
A certain analysis result can activate a certain type of components, such as a harddisk drive 272 and a floppy disk 
recommendation. 27 *- The peripheral controller 266 can be connected to 

Examples on rules for the recommendation generator one or more Peripheral components, such as a keyboard 276, 
include: 25 a mouse 282, a digital camera and a digitizing board. The 

If a user is disrupting a session then the interaction graphics adapter 268 can be connected to a monitor 278. The 
controller circuit board 280 can be coupled to audio signals 281 and 

warns the user. 244, video "S^; m & toe network interface adapter 270 can be 

asks if the user wants to terminate her session, connected to the nerwork 256. The processing unit 260 can 

if the user desires to end her session, terminates it and 30 te « "pplicanon specific chip, 
informs the remaining group. Different elements in the present invention may be in 

The interaction controller asks a user who is very weak in ?™ T com ?°™ nXs - For example the initiailizer 

the subject if he wants to 10X subject ****** sl0T *& medium 120 ' recom- 

leave the group, mendation generator 116, the performance analyzer 114, the 

learn individually 246 or 35 report S^ 613101 ^ ^ e interaction controller 104 can 

consult an instructor. be in the server computer 252; while the interactive devices, 

1f j llf - f . , a * . # . _, . HO and 112, and the client communication controllers. 106 

If dunng the dialogue sess on. the group is distracted from md 108 , can be in client computers. In another embodiment, 

£ taSrion SESTET* ?!?? T' a of * e mteraction 104 can be in the chent 

the tnteracoon controUer guides the dialogue by w computers. That part can be responsible for analyzing the 

TroSttoToV ^ 10 ^ nionitored inputs Was to reduced J£ 

. t Lj„„ ^ m ' _„,. . .._ . . that has to be transmitted through the nerwork from the 

asking Ae group a question in the subject, or cliew t0 & ^ J* 

toftedtnT" **** " h8Ve *" Users c£, use me system 100 to' work on a subject In 

ac K inft Jf fKa _ _ . . , . ' 45 working on the subject, the users learn something about the 

asking if the group needs help in the area they are m ^ cl togelher OT J ^ one embJment, the 

working on, and if so, suggesting the gjoup to ask is a predefined problem, and tie users are solvSg 

quesuons, or to repeat what they have just worked theUlem.Tluough solving the problem, the usen 2 

Examples on rules that are directed to presentation <n ^S^S ^ * 

approaches to a user based on the user's char^S * ^^TJ^T^ °* f 8 ^ 15 f 
•^ clude . ut * restneted to a group-learn environment. A user can use the 

. >*• a • . . . Je , system to work on a subject individually. 

Avoid askmgauserwhodominatesadialogue session any In this invention, a subject to be worked on by users can 

question. be of varying scope of complexity, and can be in many 

If a user is working on the subject passively, then in the 55 different fields. In one embodiment the subject is math. 

next available opportunity the interaction controller ematics or history, or the JAVA programming language. In 

asks, in the broadcast mode, the user to answer a another embodiment, the subject is on methods to bake a 

question, or s custard pie. In yet another embodiment, the subject covers 

suggests the user t work on his communication skill. theories and techniques on selling h uses, and the users can 

Based on information from, for example, the rec mm n- 60 be real estate agents, with the learning sessions allowing the 

datum generator, the report generator 118 can generate agents to network also. 

different types f reports, such as one report showing what The following is a detailed example to help illustrate the 

ach user should work on, and an ther report showing the present invention. The subject is Mathematics, which can be 

overall performance of the users, or the effectiveness of the divided, for example, into many topics and line items. A 

system. & group f students or users are learning ne fits t pics. One 

The storage medium 120 stores different materials on the major topic is the aut mata theory, and it can be divided as 

subject. It can also st re the users' overall performances. follows' * 
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the interaction controller. This discussi n period can serve 
, a ^ oan y purposes, such as motivation, enhancing the under- 
Major Topic: Automata Theory ~" standing of the Union property, and testing the users' 
Minor Topic: Finite Automata (FA) understanding. For example, the interaction controller pre- 
line item Deterministic Finite Automata (DFA) 5 sents a description of three finite automata FA1 FA2 and 

sssrssKsssr <NDFA) ™ t m FA3 accepts *• r on o{hm ^ s * fai ™* 

Minor Topic: Pushdown Automata 1De interaction controller further presents an expres- 

Une Item: Detenninistic Pushdown Automata ^ 0n EXP, and verifies that EMP is accepted by FA3. The 

Non^letenninistic Pushdown Automata question is: 

JESSE S.'ST 10 J S ^ ^Pted by FAI. FA2, both or none? 

Minor Topic: Languages mers can pick one of the following four choices as the 

Line Item: Regular Expressions (RE) answer 
Regular Grammars (RG) FAI 
Context free Grammars FA2 

S!HSSE« » FAI and FA2 

Context Sensitive Languages None. 
Minor Topic: Finite Automata and Regular Expressions (FA & RE) In this example* the answer is FAI 

ir^ Jr^^sMr' * FA <PFA) ^ «™' <** ^ « a*** 

Concatenation (P-fa-cono session. This can be done by presenting the questions to the 

Equivalence Between FA and RE (FA = RE) 20 USCTS and asking them to solve it 

Determining re Accepted by a fa (FA ■> RE> In one embodiment with interactive devices includine 

Constructing a fa from an re (RE => FA> moniton, and the user-interface as in FIG. 3. oredSogto? 

™""~ * designated as Answer Question, 206. Activating this 
Leaning materials on the different line-items can be pre- to&og box provides an indication to the interaction control- 
stored m the storage medium 120. Generating such learning 25 kr that one user would like to answer the question The 
materials should be obvious to those skilled in the art. and question with the four choices can re-appear on the monitor 
will not be further described in this specification. for selection. 

th. ta m S!t!^ Pl | , ir U ^ rS i Cam fa four J * ree - hou i s sessions, If after discussing for five minutes, the users still have not 

^TSK^ffT 101,13,3 ^ ^P^ 10 " 5 reS P° nded ™* an answer, or if a wrong answered has been 

(FA & RE), with each session covering a line item in that 30 selected, such as (FAI and FA2). the performance analvzer 

tXtlT; 5s """p 16, ? ** 5r c h A ours m devo,ed ™ « d such Nation ^^SSSSiSZ 

sU^FSZ l^rr ^ ^ FA (P i?' - d * C 116 ^ « enerator 116 can commend JXSS 
second three hours to Equivalence Between FA and RE. controller 104 should provide one or more hinisfa the 
During the mtenm period between two three-hours sessions, broadcast mode to the users, such L foUowS? 
users can access materials to lean, individually. 3 s Hint: The answer is either FA o* FA2 *' 

A group of four useis-Chnsune. Shirley, Joe and Tom- to one embodiment, another dialog box asshowninFIG 
are leanung together. They do not have to be located at the 3, is designated as AskQaestioJ uSt lu, *Zr^T6m 
same place, as long as they are connected by a network. activates Ibis dialog boxhe can ask a ouestion A? a £ t2 
Assume that they have accessed their corresponding inter- can ask thTqSfn fo ti^ uScat .ST. Cta 
active devices, and are ready to work on the subject. In one 40 mode. There « many differed approaches for a mtemTo 

SSSZ^fSSl 80CS thn,Ugh U !! interaCti0n ««PO-d to aq^stion. Afew quesZ^rSg ap^SS 
controller before the information is propagated to a user, are discussed in Appendix 1 ^ p 
ach ofthe interactive devices has registered its address with As the users progress, Tom* asks the followine question in 
the interaction controller. In another embodiment where the the broadcast mod? g q m 

communication controllers can be directly coupled to each 45 What is the Union Property? 

other, the interaction controller sends information to the four The performance analyzer analyzes the Question and 
SET" ™ 10 m UP **nniJes an answer. In S Z£Z£££Z£ 

FIG 7 shows one embodiment of a set 300 of steps for ^^^o^X 
Zll^t P ™Z aVen i 0n t0 WOTk ° n sub ^ *> *° determines that the^S^^SSSaSSS 

^eraS (^1S?mirea^^ e ?,~ mroIler 102 based on me rule that if a JT!5E£ to 

generates (step 302) materials, such as the Union property. question, the interaction controller will broadcast the 
to communicate to the users for them to work on the subject answer. The answer^ oe aTfoUows- 

S3 ^ f £Ufferem f0nDS - F f r If mere are two finite amomata, FAI and FA2, accepting 

generating materials can be retrieving materials from the 55 languages LI and L2 resoectivelv and L=Ll I! 1 2 Tn 
storage medium; generating materials can be retrieving ££Ta tote automaJoTa^cepting L 

mSs f ° nna ? 8 T ^ generatin 8 Tom still does no, time he asks: 

materials can be producing quesn ns of varying scope f What does LI U L2 mean? 

the topic of discussion is to answer a question generated by ernes a response for Tom. 
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The overriding functi n can be done in a number of ways. this nile is to include a dictionary of words for each line 

For example, when the instructor starts using the system, the item. To determine if there has been disruption, a relevant 

instructor indicates to the system his special status. If die sentence is a sentence that includes one or more words in die 

instructor wants to answer Tom's question, there can be a dictionary of w rds of the current and previous line items, 

dialogue box in the instruct r's monitor, which gives the 5 Every word in a relevant sentence is relevant, 

instructor such an option. When the instructor activates that The relevancy percentage^ all relevant words)/(all words 

dialogue box, the interaction controller will select the communicated by the user)* 100. 

instructor's response for Tom's question. In another embodiment, a user is considered disrupting a 

In one embodiment, users* communication during a dia- dialogue session if his communication has little relevancy to 
logue session is not monitored, or at least a portion of the 10 other's communication in the session. One way to analyze 

communication is not monitored. In some situations, moni- the relevancy of Tom's response to Joe's communication is 

toring the users can change the dynamics of the users* to create a temporary dictionary of words from Joe's inputs, 

interactions, if they know that they are monitored. In another This dictionary can be generated by first extracting every 

embodiment, the users can stop the system from monitoring, word in Joe's inputs. Then remove from the extracted words, 

for example, by activating the dialog box at the bottom of the *U of the articles, prepositions and all forms of the verb to 

screen, labeled. Stop Monitor, 210. In this mode, the users For the remaining words, generate the common syn- 

can still communicate among themselves, except that the onyms of every word. This set of words is grouped together 

interaction controller stops monitoring their communication. to form ^ e temporary dictionary. If every word in Tom's 

With users' inputs monitored, the performance analyzer response cannot be found in this temporary dictionary, 
analyzes them, such as analyzing the content of each user's ^ Tom s res P onse has no relevancy to Joe's communication. In 
input, the communication process, including how often each 20 one embodiment, m a session, if 80% of Tom's response has 

user communicates, and the mode of communication used- D0 K ** evan 5 l ° c ?^™ ca 4™ T ™ * responding to, 

unicast mode, multicast mode, or broadcast mode. ^ commumcauon is from the system, or from 

In one embodimenu the performance analyzer determines 2S?^2J f c ^ ldl ; rcd dm ^. 10 

. , „ - tUr% „_t~ . • session. In another embodiment, the temporary dictionary is 

the relevancy of the users inputs in die dialogue session. fBnenled from ^ of ^ communication macte in a specific 

Tins can indicate, for example, if die users have been ^ frame , which C an be between Tom's input priorto the 

gossiping for a long period of time. If for a pre-set period most recenl response Tom's most recent response; note 

of time during the dialogue session, such as five minutes, the that between Tom's two responses, one or more other users 

four users do not seem to be communicating on the subject, have communicated. Tom is considered disruptive if Tom s 
the interaction^ controller can send a message to at least one ^ i„p m relevancy is less than 20% in this time frame, 

of the users. The message is for guiding the discussion back i n one embodiment, the performance analyzer 114 can 

to the subject. In the present example, the message can also analyze other traits. For example, during interaction in 

simply the dialogue environment, compared to other users. Shirley 

Is the problem solved yet? rarely communicates. The performance analyzer 114, based 
The interaction controller can broadcast the message to all 35 on a M of ^ de tenn i nes ^ Shirley probably is not an 

four users. extrovert An example of such rules is as follows: 

n Z T ^T^T^i tde £W*" 15 "J™ a (l)Ave^Com=TTieaverageamountoftimethefourusers 

number of words related to the subject, for example, five communicate 

hundred words, pre-stored in the storage medium. Examples e>\ i* • * • ♦ v/a 

of such words include: (2) J f (the 3111011111 of **** a communicates)/Ave_ 

nCA vrrsp» . „ . * . . , 40 Com<0.25, then the user is not an extrovert 

ntS detemiTastlc ' fiMte - momat * ^valence. On the contrary, if during the dialogue session. Shirley 

Son. ^P" 5 " 10 " 5, gra,nma^S • Um ° n ' and concat " communicates three times more than others, Shirley is 

it a*JL~ ?^ , m ^ • ^ r ^ _c considered to have dominated the dialogue session. 

L^Ztt ' P? bnM ?? T' » ™<*t* r "™P*< * *>' more than80% of the time, 
lyzeroeciaes mat autour users nave not used any of the five 4J when Tom asks the system or another user questions on the 

hundr^word^ (he analyzer will conclude that the users subject be asks in the unicast mode, instead of the broadcast 

have been distracted, and provide such an indication to the rt „ * ^ ,u i **a a . *u * 

_ k j * or the multicast mode, the analyzer 114 determines that 

wdl recommend the mteracuon controller to broadcast the requires distinguishing a statement from a question. One 
.above message to guide the users back to the subject „ W J , 0 p^J^ * detenrunation app^Ltely isbj 

Another way to decide whether a user, such as Joe. has not _.!T a . fhA fn „ ^ F y y 

been distracted is to calculate the percentage of relevancy of a ^ following: 

hi. s™..». i„ »k» A;»\!Z.»ZlZi!!* tw a i 1 01 A sentence that starts with a noun phrase is a statement 

me S^fr^s " Such langua * e inter P retat ' on techniques can be found, for 

A . . . ^ , example, in Natural Language Understanding, written by 
A sentence having one or more of the subject-related 55 James Men md published by Benjamin Oimniings. 

words is a relevant sentence. After the users have resolved the problem presented by 
Every word in a relevant sentence is a relevant word. the interaction controller, or after the allocated time for the 
If (all relevant words )/( all words communicated by the dialogue session, whichever is earlier, the interaction con- 
user)* 100<20%, the user has diverted his attention trailer terminates (step 308) the dialogue sessi n. This can 
away from the subject 60 be d ne, for example, by sending such a message to each of 
The above calcuiati n can be modified. One approach is die users, telling them that the dialogue session is over. Also, 
to remove all f the obviously unimportant words from the the interaction controller can stop relaying information 
communication, such as articles and auxiliary verbs, before among the corresponding communication controllers, or can 
performing the calculation. ask each communicati n controller not to relay informati n 

A user can disrupt a dialogue session if he communicates 65 to any tber communication controllers, 

frequently, and if his communication has a relevancy per- After termination, based on the determination by the 

centage of less than, such as, 20%. One way t implement recommendati n generator, the interaction c ntroller can 
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generate materials for the users, and let the users commu- on their understanding in the subject These materials can be 

nicate in another dialogue session. The steps shown in FIG. individually accessed after the first session. 

duS^^t m™?^ StCP ^ * Se0in8 8 to baweea * first and the second sessions. Shirl y. 

duration or time to communicate. t k mil „K k_„ ■ _ . . . . . ' / 

Assume that the next area to be taught is Concatenati n s , * T*"?, ^ ^ 

(P-FA-CONC). Prior analysis by the performance analyzer ' Z ^ ^^fi^^T^ 0 ^^^ 

114 indicates that Tom is weak in P^FA-UNION In one ? g * nerated , for Smrle y- matenals can «* 

emhJiu^T tn hi>in Tnm .,3, „' ,[? ' „; ™ ? ne tailored to her weaknesses so as to raise her understanding 

a multicast mode to Christine, Shirley and Joe; and another a, „ ^ ^o.lJT 'T.. n • • - . 

set of materials will be sent in a unicast mode to Tom! w pre-determined time, Chnstme. Shirley. Joe and Tom 

As discussed above, the interaction controlir Z can 2aS?K2S^?^^TS 

generate materials tailored to individual needs. This can be * j SSrS^E „T J ^ mv ^ nce n FA 

on each topic m the storage medium 120; ^..,k.T i • t • p ~ . 

In one embodiment, materials having different difficulty fteS^S ^^T''^ ^ 

levels for different users occupy simito presentation urn* ^^^"f £ m J ~ and based °, n Joe ? P rcvious 

The different materials should not affect me different users E?i performances - ** Performance analyzer determines 

significantly in their later dW^JSETS , £ ' ^ ■*■*•<*«* 

embodiment, a user who is more knowledgeable in a line- \f 
item receives more questions on the line-item, with the 

additional questions being more difficult and covering more (a) a user is weak in a subject, 

subtle concepts. In another embodiment, a weak user 0>) the interaction controller suggests the user to work on 

receives less complicated materials, or materials that do not 25 * c ^i^ 1 individually, 

cover certain sophisticated areas, or materials with more (c) the user has not worked on the subject individually 

details on simple concepts. As an example when a weak user using the system, and 

is learning how to differentiate, he will not be taught the (d) the userremains weak in the subject, then the user may 

theory behind differentiation, while the strong user will. not have a good or positive learning attitude. 
Using concatenation as an example, ^ The performance analyzer conveys such information to the 

First define the Concatenation property: the class of recommendation generator. The recommendation generator, 

languages accepted by FA is closed under concatena- based on another set of rules, determines if Joe should work 

tion. If there are two FAs, FA1 and FA2, accepting on the subject individually. An example of such rules is as 

languages LI and L2 respectively, and L=(L1 concat- follows: 
enate L2), then there is an FA accepting L. 35 if 

More complicated materials means when presenting (a) a user is weak in a subject, and 

examples on the property, a more complex FA1 is used. n>\ »k* a~>« u- . , , . 

h a FA JLm M a«KS "JERK £ 'SXS^ ^ 

than a simpler FA A weaker user can receive more , v - , " ~* , 
details explaining the concept of concatenation. 40 (a) you want to Ieani «*vidually, instead of in a 

Generating such learning materials should be obvious to group? 

those skilled in the art, and will not be further described U k ves * then 

here. (a) log the user out of the dialogue session, and 

In one embodiment, to conclude the first session, the (b) in the unicast mode, provide learning materials to the 

interaction controller generates a test on the subject. This 45 user. 

can be done, for example, by the interaction controller At the end of the fourth session, in one embodiment, 

accessing the test from the storage medium. The test is performance and trait information on individual users are 

broadcasted to Christine, Shirley, Joe and Tom, for them to not kept However, the performance analyzer generates a 

answer individually. Their answers help determine their summary of the performance of the group in learning the 
progress in learning the subject The test may include a 50 subject and stores the summary in the storage medium. One 

number of multiple-choice questions for the users to answer. such summary may be as follows: 

After the users have answered the questions in the tests. The four users should have understood the Union prop- 
each of them sends the answers to the interaction controller erty. 

in the unicast mode. The performance analyzer again ana- Based on the analyses by the performance analyzer, the 

lyzes the answers received. Based on the test results and the 55 recommendation generator can generate a number of 

analyses on prior inputs, the performance analyzer deter- recommendations, for example, 

mines each user's performance, and some of their traits. For When the four users access the system again, the system 

example, if Chnstme is very good in prior performances, but should start teaching Regular Grammar, 

has very 1 w score in the test the performance analyzer may In ne embodiment the report generator, based on 

conclude that Chnstme understands the subject but does not 60 informati n, for example, in the recommendation generator, 

perf rm well I under : pressure. generates a report for each user indicating what they have 

At the end of the first sessi n, based on the analyses learnt with their strengths and their weaknesses. The report 

performed by the performance analyzer, the rccommenda- can also indicate a user's attitudes that should be ncouraged 

tion generator suggests that Joe and Shirley should spend or discouraged For example, the report might indicate that 

s me time on the Union property before the next session. 65 Joe should be m re enthusiastic with his work, and should 

The recommendation generator may also suggest the other improve on bis learning attitude. These reports can be for the 

users to work on certain areas if they want to further improve users, or for the users' guardians 
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JE£E% u£ , V ^ OVeraU *** aVeT ^ education . what «ney have worked on so far. 

performance and the system s effectiveness. For example, at and their summarized perf rmance. Their summarized per- 

*e end of each sessi n. there can be a test f r each user. formance can include the following- 
Based on the test perf rmance between sessions, the report They should be familiar with Regular Grammars, 
can show how much the users, as a group, have improved. 5 The best user is familiar with Context Free Grammars, 

userregisny Such information helps Lisa decide if she wants to join the 

One embodiment of the system uicludes a user registry, group of users to work on the subject, 
with FIG 8 showing one embodiment of some of the In yet another embodiment. Lisa is allowed temporary, 

fractions .t performs. The registry restricts users, 351. to use 359, access-such as twenty minutes-to a dialoguTS 
*e system to work on the subject, or serves as a gatekeeper to to interact with, for example, the instructor or me exS 

resmcnng users who can use the system to work on the users. She may ask them questions, and vice versa. This 

,{ ' ... . , again will help her, and the users or the instructor, decide 

In one embodiment, each user has a key to get into the whether she should join 

ZTlJ!" ^ °? ^ * Pa f 3 fin 8 ei ? rint ' «■* ima 8* I" anotoer embodiment Lisa is allowed to join, but not as 
I?.?- * T * b,0me ^u characteristics °f " a full user. Lisa's participation is limited, 363. She is only 

me user Based on an appropriate peripheral device, typi- allowed to observe (not explicitly shown in the figures). Z 
cally with its corresponding software, the user registry 300 she cannot respond. She is allowed access in Ae uni 
recognizes and authenticates a person's key based on a set directional modT 

%JTTt. ^3* » sv «em. If authenticated, she is In one embodiment, after admission, based on the infor- 
med en *y™° * e ^ff 111 - » mation she has submitted to the user registry, if the system 
e n tTf m ^"T U also de«ermmes decides that she is slightly below an average user, the system 
ett) of new users. Any person accessmg the system will be may generate materials forher to work on individually. UntU 
^ifsheisapotentudoranexistmgusei : Assumethata she has caught up with the average user, as shown, for 
potenual user. Lisa, would like to access the system. She example, by the results of a test administered to her she wUI 
respondstomeuserreg^try-squestionthatsheisapotential 25 not be allowed to join the group to work on ttS£cT 

Sr^LTh re ^H^^ ,0O ^ m ^ mherS0me ta one embodiment thfuser regSy can S an 
t Z ^8 ber, ^ ro ^ forexa ™P^^)name. existing user, such as Christine, from jouting. 361. one or 
(b) age (c) the schools graduated from or attending, (d) the more other users to use the system to work on the subject 
SCSSTS" WOr ^ ?0n - ™ «* 35 * "0« ending her materials. The us« <^ be S 

one «5£?JE T a ^ a$oask her ,0 submit » » >«>ve. For example, if one of the users, such as Tom. is 
one of her recent pKtures. through a scanner or an appro- extremely weak as compared to the other users, the recom- 

ELh h 6 „ deV,Ce ' $ l Ch 35 I ^ If ShC U mendarion S enerator might suggest that Tom should leave 

h, ""J* See " by ^ USer$: f0r ** ^"P- ™* information is men transmitted to the uler 

mo2 i tELS J* " •T < , 0D ^ S " een ° f a re * s0 * ,n one embodiment based on the information, the 

T °L ,t U,ClUde ^ T m, ° r -. * uw rcmoves Tom ' s ke y *e set of pre-stored 

^ embtxument the system provides Lisa with an keys of allowed users, which will restrict him from future 

^tn Xa T ^ eSt 0311 ta ?*ject-dependent and entry into the system. In another embodiment, the interac- 

S *e astern. The test results affect whether Lisa tion controller can stop sending information to Tom. and can 

may join the exiting users to work on the subject. forbid Tom from joining future dialogue sessions In y* 

n^iSS T ^ "formation, in <o another embodiment Tom's name or sorial sSty numbe 

e,Lnt^„l^^ Ct0r ^ ° n , her entry : ^ «»r other biometric information may be stored to prevent Tom 

example, the mstructor can receive her information in an from using the system into the future. 

SS„ZL™ en T Sy ? Cm - HiS tey indi - moneembodimentaninstructorortheexistinguserscan 

«™ ™T,L ^ whKb ,f?™ nun entry to the key restrict Tom's future access. The instructor again can access 
storage area of die user regmry If the mstructor allows Lisa « the key storage area to remove Tom? key. In one 
to join, he can add Lisa's name into the key storage area, and embodiment the existing users can activate a dialog b°ox 
acnvate the log-m process for Lisa. Next time when Lisa labeled. Remove User. 214, as shZZ m FIG 3 The sLern! 

e^rTke^wSU TSSf ^ IT" " d ^ * b " ed °" SUCD *» fOT exa^le^ill '2 SEt 

enter a key, which wdl become one of the pre-stored keys. activating the box to name the user whom she wants to 
If the mstructor decides not to admit Lisa, be will so 50 remove. After the indication, the rest of tl* userTexc^uhe 

rest™ 1 ^LT,? ? "* L hiCh J ill . Send a rejection 0ne wh o might be removed, will be Z vote n Z 
refuse to Lisa next tune when she tries to access the user's removal. In one embodiment if more than 75% of the 

in -,nmK.r 0m K^; m „. » ,u users agree to remove him. he will be removed. 

J?^n??« \? °I m0re ^ existing users In yet another embodiment, the user registry can also 

lt aT£m^ 55 "»« 30 eristin g user, such as ChristinVto consfder 

Jel her mformanon. which again can joining another group. 365. In this embodiment the system 

iSf'T majls - ^ "» k men access the system includes information of summarized characteristics or per- 

Z ^Ti m „ ^ 5855,011 ? ey would ^ fom>anceof a number of groups. If Christine's level is mS 

fabled Join Ift^nt, 5 ^ ^ ^ 3 * "gner man th se of th Sg group, and if Christine's 

S^i?" k„ discussion, one of the users can 60 level matches a second group, the use7registry can suggest 

whX SLUSPj ^ 10 PW 3 n°n as to Ch^tine to try registerTL sec nd grou^ If drffi 

^ide n r m rd^ ma \f *■« ~r^^ja^sst-s 

provide her with a summarized profile of the existing users. Christine is asked to leav . the user reristry cansueLt 
The user registry can retrieve. 357. such a profil from the « Christine the groups stesh Jf SdSffiT 
storage medium. The summarized profile can include The user re Sr^ can be used byTsS workm g on 
mformauon. such as the number of users, their average age, the subject mSuaJJy iTone embSnt Z^!Z 
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includes the user registry restricting one or more users to use if independent of subjects, Christine always works passively 
the system to work on the subject individually. In this and directs her questions in the unicast mode to the inter- 
embodiment. the interaction controller does not set up any action c ntroller. and Christine's performance in m st sub- 
dialogue sessions: for example, it can either not set up, or jects is in the highest 25% among the users, the analyzer 114 
remove the aJready established, communication controller's 5 determines that Christine is a private person, and may not 
PMP connection. The interaction controller can generate have a helpful attitude. Thus, as more information on a user 
materials for a user, and monitor his inputs to the system, is collected, more and more of user's traits can be identified, 
such as by asking htm questions, and monitoring his Notepad 

answers. Users can use the system to work on the subject In another embodiment, the system includes a notepad. 

However, users cannot use the system to communicate with to 122, with FIG. 10 showing one embodiment of some of the 

other users. Similarly, a potential user can ask for summa- functions it performs. A notepad 122 allows a user to take 

nzed performance of existing users or other system or user notes. One embodiment allocates an area for each user in the 

information, but cannot have any dialogue session with memory for used as a user's notepad. A notepad can be 

existing users. shown as a small window at one coiner of a screen, if an 

User-profile storage medium ,5 interactive device includes a monitor. In one embodiment. 

In anomer embodimenu the system mcludes a user-profile each notepad is coupled to the interaction controller and to 

st rage medium, with FIG. 9 showing one embodiment of its corresponding interactive device 

some of the functions it performs. The user-profile storage As Shirley is working on a subject, she can take notes in 

me ^ um <^ « ore - amon 8 materials, at least one user's her notepad through her interactive device. The notes can be 
^ r T?o F ° r eX!m, P ,e ' m one embodin *nt, *e storage 20 her personal property, only accessible by anyone with her 

medium 128 stores the user s personal information, such as key. In taking notes, Shirley can cut materials presented to 

his name. age. the performance analyzer's analyses on the her. and paste. 450. them into her notepad. She can link 452 

users performance and traits, and the recommendation certain parts of her notes to materials generated by the 

generated by the recommendation generator on that user. interaction controller for her. The link can be a point link 
Reports on that user can be generated from information in 25 458. This can be done, for example, by having a dialo» box 

the user-profile storage medium 128 marked Point Link, 216, as shown in FIG. 3 By activating 

In one embodiment, the medium 128 stores a user's input that box, she can hypertext link an area in her notes to a 
charactensucs. 406. such as the percentage of his input that certain point in the presented materials. She can also book- 
is relevant to the subject, the amount of time he has mark a certain section in the presented materials, which can 
communicated relative to others, and how often he has 30 be replayed if desired The length of the section can be based 
communicated in the unicast mode to the interaction con- on time, such as a minute of the presented materials. Shirley 
trailer as opposed to the broadcast mode. The medium can can also review previous notes and modifies them to reflect 
also store a user s performance, 404. in working on a the latest knowledge just learnt and information just 
subject, for example, his test scores, and the accuracy of his received. 

responses to questions. 35 In terms of implementation, in one embodiment, the 
The medium 128 can also store a summarized profile of system has multiprogram or multi thread capability to 
a group of users, which can include all of the users. The execute more than one program at a time. This multiprogram 
summarized profile mcludes a summary of the profiles of the or multithread capability also includes functions for inter- 
group of users. The group of users may be identified by a program communication, such as cut-and-paste. shared stor- 
es-name, for example. Christine, Shirley and Joe. as the 40 age or memory, or messaging among programs. In this 
Magnificent Three. The summarized profile can be the embodiment, one program is devoted to executing notepads, 
profile of the Magnificent Three. and another is devoted to executing communication control- 
In one embodiment, the medium also stores the commu- lers. This environment has a separate work area, such as a 
mcanons of aU of the users. 402 The communication can be windowed screen, visible and accessible to a user. This area 
stored individuaUy. In one embodiment, each user's com- 45 is allocated for the user to take notes. While taking notes, if 
murucation may be accessed by that user, but not other users. Shirley intends to add a bookmark to certain materials she 
In another embodiment, each user s communication may be has received, she would mark the beginning and the end of 
accessed by other users also. For example, to verify Chris- that section of materials, and give that section a name. That 
une s prior admission of her ignorance in F-PA-UNION. name appears in her notes. Activating that name will auto- 
Tom can access Christine s prior communication to search so matically bring thar section of materials to her work area for 
for her admission. her to review 

In one embodiment, the user-profile storage medium is In one embodiment with bookmarks, if there is an ending 

separated into a private and a public sector. The public sector mark, but no beginning mark, the system will automatically 

(not explicitly shown in the figures) can be accessed by any add a mark to the beginning of the material of the current 
person, such as a potential user, while the private sector can 55 line item. Similarly, if there is a beginning mark, and no 

be accessed only by those with specific keys. For example. ending mark, the system will automatically add an ending 

an instructor, with her key. can get into the private sector. mark after the end of the material of the current line item! 

which can store information such as each user's individual Note that Shirley can later modify bookmarks she has 

performance in a subject previously created. 

As a user spends mem time with the system, information 60 In one embodiment point-link can be implemented in a 

gathered on that user becomes more detailed, which pro- similar same way. Shirley can link an area fom her notes to 

vides better understanding on that user. For example, if a point in the materials presented to her. Those materials can 

independent f subjects, Tom always asks questions in the belong to a line item. In ne embodiment the materials 

unicast mode to the mteracn n controller, and Tom s per- wfthin that line item will also be stored for future access. She 

1 St SUbj< *!f ^ m ^* range as « can again designate a name in her notes to represent that 

comparedto other users, the analyzer 114 determines that in link If she activates that name, materials starting from that 

general. Tom s confidence level is 1 w. On the other hand, point will automatically show up on her monitor, Ind she can 
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also scroll back and forth materials in that line item. She can The above example is based on four to five users 

read those materials— or those materials can be read to However, the present inventi n can be used by two or more 

her— until she wants to go back t her n tepad. At that time, users. In ne embodiment, a single user can also use the 

she can use a go-back key stroke t return t her notepad, system t work on a subject individually. In another 

just as one goes from ne screen to the next screen and back 5 embodiment, two users are considered as a group, 

when one is navigating the World Wide Web. In yet another embodiment, more than one users, such as 

In one embodiment, the interaction controller also guides, are working on a subject They share the same inter- 

454, Shirley to take notes. One approach to guide is by active device. For example, they watch materials generated 

generating a summary of the materials on the subject The on * e same monitor, and they input through voice. The 

summary can be just key words in topic formats as illus- to s P eech recognition system has been pie-trained to recognize 

trated in the description for finite automata. The summary ^ vo ' ce °* eacn useT to distinguish inputs of one user from 

can be pre-stored with the materials. another user. If there is ambiguity, the speech recognition 

In one embodiment there can be a dialogue box for sys 5 e _ n ?. can *•* t0 clarify their inputs. In another 

summary in Shirley's notepad. When Shirley activates that em ? wumew ' each user has an interactive device, except that 

dialogue box. Shirley's notepad sends a request to the 15 "J T!n?? * "fP""* 1 imo . tw ? P 0 ** one part is 

interaction controller/which generate the^umrnary, ana another pan is shared by all of the 

can display the summary in Shirley's notepad^cenam ZLr °IS TS?£° ^ € ST tt * T 6 

can be highhghttd. Shirley then decides if she wants to add l„ one embodiment th£ image of each user is Saved 
materials in that top,c in her notepad 20 on at least one other user's interactive device when the Sei? 

In one embodiment the amount of guidance to a user are interacting in a dialogue session. The image can be a 
depends on the user s inputs. 456. For example, the amount user's picture, or an identity icon selected by the user, 
of details in the sunimaiy for ■ » user depends on the user's In one embodiment users communicate in a dialogue 
performance in the subject If Shirley is very good in the session orally through speakers and microphone. In the 
subject the summary might include minor topics, but not to 25 monitoring process, speech recognition techniques that are 
the details of line items; however, if she is weak, the not 100% accurate can still be applicable in one embodiment 
summary might include line items also. In another of the invention; in other words, every woid does not have 
embodiment the amount of details in the summary depends to be correctly recognized. The reason why a speech- 
on the overall performance of all of the users, such as recognition accuracy of about 90% is sufficient can be 
Shirley. Christine. Tom arid Joe ro shown by the example of the analysis of whether the users 

™ y " . a P ot ^ er u ? n ?^ )dunent - ±e mteracaon controller have been distracted away from the subject of interest: one 
guides Shirley by highlighting certain areas in the materials rule is to determine whether the group's inputs have less 
generated for her. and suggesung Shirley to take notes in than 25% relevancy to the subject Such determination does 
those areas. The areas highlighted can depend on Shirley's not require 100% accuracy in speech recognition 
performance in the subject For example, if she really 35 A few embodiments include implementing rules. In one 
understands the subject the interaction controller highlights embodiment these rules are embedded into programs, 
very selectively. Upon Shirley s consent such highlighted A few embodiments also describe the interaction control- 
areas can be hypertext linked or copied to Shirley's notepad ler setting a duration of time for a dialogue session. In one 
Shirley can activate the system to save her notes, embodiment the time to tenninate the dialogue is not fixed 
mcluding. for example, notes she has created, the summary 40 by the duration, but has some tolerance. For example, if the 
created by the system, bookmark references, hypettext-link set duration of time is ten minutes, right at the end of the 
references and point-link references, to a storage medium for ten-minute period Tom is answering a question asked bv the 
future access, or for transfer as a separate file to another system. Then, the interaction controller can wait for Tom to 
??" atIon " . . . . finish with his communication before terminating the dia- 

Note that the notepad functions can be achieved orally. A 45 logue session; in another embodiment the interaction con- 
user can take notes through dictating into a microphone, and trailer can extend automatically the time to tenninate by 30 

•fiu" „k 'SlT* v k , • SeC0nds ' whUe « Ml * ** a such * a "inking 

Tbjs notepad can be used by Shirley if she is working on red light shown in each interactive device, that the dialogue 

the subject mdividuaUy, instead of in a group. In one session should be over. In such embodiments, the time to 
embodiment the system includes notepads. The interaction 50 tenninate is approximately at the end of the set duration: in 

controller generates materials for Shirley and guides Shirley this embodiment 'approximately' means that the duration is 

to take notes. In this embodiment the interaction controller not fixed but can be modified by a tolerance period such as 

does not set up any dialogue sessions; for example, it can 30 seconds, as provided by the interaction controller. 

™lT n rL7^ m ^ ^ ^ I" yet another embodiment the interaction controller does 

municanon controller s PMP connecuom Though Shirley 55 not generate materials on the subject to communicate to one 

can use the system to work on the subject individually. or more users for the one or more users to work on the 

Shirley cannot use the system to interact with other users. subject However, the interaction controller still establishes 

Thij imteracuon controller can also monitor Shirley's inputs dialogue sessions, and monitors the users' inputs to be 

to the system. The interact! n controller can ask Shirley analyzed by the performance analyzer 

questions, and monitor Shirley's answers. Based n the 60 One embodiment of the inventi n includes an interactive 

7TZ~TZ£T Ct l 0 ? C ntroUercanmodif y *cam urn controller performing a number of tasks, including generat- 

h^TZl^LZ V~ 1 ^ mg materials on a subject to communicate to one or more 

In one embodiment implementing such notepad features users for the one or more users to work on the subject 

can be done through markup languages, such as HTML or setting a durati n of time for users to communicate, starting 

^ • SU ? ^'T"? 0 " ** bvious «> *<«e « a dial gue sessi n for users to communicate in an are! 

stalled in the art and wul not be further described in this related to the subject; and stopping the dialogue session 

ure - approximately at or before the end f the duration of time. 
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One embodiment of the invention includes one embodi- database may be unique. Such values are kn wn as key 

mem of each of the following: the user registry, the inter- values, and their c rresponding attributes are known as key 

action controller and the performance analyzer. In this attributes. 

embodiment, the interaction controller generates materials One embodiment of the database includes a grammatical 

on a subject for one or m re users who can use the system 5 ^M*, or more topic-related tables, and two semantic 

to work on the subject, and monitors at least one user's tables. In a general sense, the grammatical table determines 

inputs to the system to be analyzed by a performance ™e grammatical meaning of each word in the question, such 

analyzer. However, the interaction controller does not pro- whether a word is a noun or a verb. Each topic-related 

vide the option of allowing the users to interact using the table groups data related to a topic together in a specific 

system. I0 format Separated into a topic-dependent semantic table and 

Other embodiments of the invention will be apparent to a topic-independent semantic table, the semantic tables 

those skilled in the art from a consideration of this specifi- define the semantic meaning of each word, such as whether 

cation or practice of the invention disclosed herein. It is a word refers to an algorithm or data in a topic-related table, 

intended that the specification and examples be considered The grammatical table defines the grammatical meanings 

as exemplary only, with the true scope and spirit of the 15 of words used in the natural-language question. If questions 

invention being indicated by the following claims. entered into the system is limited to only one subject, such 

Appendix I as history, the grammatical table will include words in that 

This appendix describes a number of answer generators, subject, and words commonly-used by a user of the system 

starting with one that can provide answers to natural- «n asking questions. 

language questions that are grammatically context-free, and 20 Each topic-related table combines data related to a topic 

then to those for other types of questions. Different tasks in m a specific format 

the following description performed by different elements There is also a table-structure dictionary, which defines 

can be implemented by the interaction controller. how the topic-related tables arrange their data. This dictio- 

A natural-language question can be in English or other nary is typically not considered as a part of the database. It 
languages, such as French. Examples of natural-language 25 does not contain topic-related data, but it contains structures 

questions are: *" of the topic-related tables in the database. 

Who is the first President? A word in the question may need one or both of the 

What are the Bills of Right? semantic tables. The topic-independent semantic table 

Where is the capital of Texas? defines whether a word stands for an algorithm or data in a 
A statement that is not based on a natural language is a 30 topic-related table. Such a table may be defined as follows: 
statement that is not commonly used in our everyday lan- 
guage. Examples are: 

For Key in Key-Of(Table) do — — — — ■ — 

Do while x>2 CREATE TABLE Topic_lndependent_Scmantic ( 

A word NOT NULL. // die word 

A grammatically-context-free question IS a question 3$ semantics. // Indicates if the wad refers co data in a 

whose grammar does not depend on the context Each word // topic-related tabic, an algorithm etc. if the 

in the question has its own grammatical meaning, and does 11 word mapped to an algorithm, that 

n t need other words to define its grammatical meaning. " t^^^Jdl^ aswUlbc 

Hence the grammatical structure of the question does not synonym. //a weight have jLvms. as will be 

depend on its context 40 // Amber explained below. 

The question includes one or more grammatical compo- * 

nents. A grammatical component is a component with one or — — — — 

more grammatical meanings, which are defined by a set of Words with similar meaning are grouped together and are 

grammaucal rules to be explained below. For example, the represented by one of those words as the synonym for that 

word president is a noun, which has a grammatical mean- 45 group of words. 

ing. So the word "president" is a grammatical component Many words do not point to an algorithm. They corre- 

to one embodiment the question-answering approach spond to data in topic-related tables. The topic-dependent 

inc udes a database with a number of tables. The data in each semantic table identifies the semantic meaning of those 

table can be further divided into different areas, and each words through matching them to data in topic-related tables 

area is represented by an attribute. Some values or data in the Such a topic-dependent table may be defined as follows: 



CREATE TABLE Topk_Dcpendeiu_Semanric ( 

TaWe^Name NOT NULL. // For a tame with the name TaMe_Name: 
Wbo_Attribute, // The attribute associated with 'who* 
When_Artribttte» // The attribute name associated with * when* 
{i-proixxm }_Anribaic // The attribute associated with an 
// interrogative pronoun or i -pronoun. 
// The symbols { } denote the word it 
// contains. Here, the word is an i-pnmoun. 

{Adj}_Atmbctc 

// The attribute associated with the adjective {adj}. In this 
// example, the word is an adjective. 



6,160,987 

27 28 

-continued 



{Nmm}_ Attribute. 

// Anributc name associated with the noun (noun). Certain 
// nouns may refer instead to an algorithm, such as 



In general terms, a grammatical structure analyzer can 
analyze the grammatical structure of a natural-language 10 
question so as to parse it into its grammatical components, 
based on a pre-defined context-free grammatical structure. 
This task uses a set of grammatical rules and the grammati- 
cal table. Then, the system transforms at least one compo- 
nent into one or more instructions using a set of semantic 15 
rules with one or both of the semantic tables. Finally, one or 
more steps are executed to access and process data from one 
or more topic-related tables so as to generate an answer to 
the question. 

Analyze Grammatical Structure 20 

In one embodiment, the analyzer scans the question to 
extract each word in the question. Then the analyzer maps 
each extracted word to the grammatical table for identifying 
its grammatical meaning. After establishing the grammatical 
meaning of each word, the analyzer uses a set of grammati- 25 
cal rules to establish the grammatical components of the 
question based on a pre-defined context-free grammatical 
structure. 

In one embodiment, the pre-defined context-free gram- 
matical structure is as follows: 



The prograrnrning-steps generator transforms at least one 
grammatical component of the question using a set of 
semantic rules and one or both of the semantic table to 
generate a set of instructions. The semantic rules and the 
semantic tables depend on the pre-defined context-free 
grammatical structure, which the parsing process bases on. 

To help explain question-answering approaches, a number 
of functions are created as shown in the following: 
Keys-Of(Table) This function extracts all the key 

attributes in the identified table. 
Attributes-OftTable) This function extracts all the 

attribute names in the identified table. 
Attribute-Names( {adjective}. Table) This function iden- 
tifies one or more attributes when the {adjective} is 
applied to the table. 

Attribute-Names({noun}, Table) This function identifies 
one or more attributes when the {noun} is applied to 
the table. 

Attribute-Name({i-pronoun}, Table) This function iden- 
tifies the attribute when the {i-pronoun} is applied to 
the table. 



<Question> = <i-pronoun> <aux-verb> <noun-phrase> (<vero-phrase>) 
where: the symbols o denote whatever inside is a meta-symbol. which has a 

grammatical meaning: the meta-symbol is not in the grammatical table. 

The symbols ( J denote whatever inside the bracket is optional. 
<I-pronoun> denotes an interrogative pronoun, which is a pronoun used in asking 

questions, and can be one of the following; what when, where, who. whom, 

whose, which, and why. 
<Aux-verb> denotes an auxiliary verb, and can be any form of the verb "to be.*" or 

"do.~ 

<Noun-phrase> is defined as <group-of-nouns> (<prepositional-noun-phrase>] 
where: <group-of-nouns> is defined as: 

I<modify-article>J <adjecUve>*<one-or.more-nouns>: 
the symbol * denotes zero or more: 
<modiry-anicle> is defined as a modified article, including a. 

an. the. this, these and those: and 
<one-or-more-nouns> denotes one or more nouns: and 
<prqx)sidonal-noun-phrase> is denned as a 
<preposiuon> <noun-phrase>. 
<Verb-phrase>denotes a non-aux-verb. and 

is denned as <non-aux-verb> [<prepositional-noun-phrase>J. 
<Preposiuon> denotes a preposition defined in the grammatical table. 
<Non-aux-verh> denotes a verb defined in the 

g r a mm a t ical table and is not an <aux-verb> 
<Noun> denotes a noun defined in the grammatical table. 
<Adjecove> denotes an adjective defined in the grammatical table. 



A word or a set of words that can fit into the structure of 
a meta-symbol is a grammatical component. For example, 
the phrase "with respect to x" is a grammatical component, 
whose grarnmaucal meaning is a prepositional-noun-phrase. 60 

The grammatical table defines the grarnmaucal meaning 
of each w rd. 

Many questions cannot be parsed based on the pre-defined 
context-free grammatical structure. These questions are con- 
sidered as ambiguous questi ns, and will be analyzed 65 
through methods explained later. 
Progianiming-steps generat r 
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Tables- Off {proper noon}) 

This function identifies one or more tables that contain the {proper noun} as a 

key value. It can be derived by the following program: 

T-Narocs 

for Table in {all Tables} // (all Tables} is a list of topic-related tables 
do 

for Key in Kevs-Off Tabic) 
do 

if any value of the attribute Key in the Table contains (proper noun} 
then T-Names » T-Names + Tabic 

endif 

endfor 

endfor 

return T-Names 
Synonym! (word) I 



This function identifies the synonym corresponding to the 
word. The synonym can be found in the topic- 
independent-semantic table. 
Based on a number of semantic rules and the grammatical 
components in the question, the programming-steps genera- 
tor generates instructions. Examples are provided in the 
following. 
A Proper Noun 

A grammatical component in the question can be a proper 
noun, which implies that it has a grammatical meaning of a 
proper noun. One set of semantic rules is that the 
programming-steps generator transforms the proper noun 
into instructions to select one or more topic-related tables, 
and then transforms other grammatical components in die 
question into instructions to select and to operate on data in 
the tables for answering the question. 

Using the topic-dependent semantic table, the 
prognirnming-steps generator first retrieves all tables where 
the proper noun is an attribute. Then, as shown in' the 
topic-dependent semantic table, all key attributes in those 
tables are identified, and each of them is matched to the 
proper noun. The table of any key attribute that matches the 
proper noun is selected for additional operation by the 40 
remaining grammatical components in the question. 

In one example, the corresponding instructions are as 
follows: 



If the noun denotes an attribute name or a synonym of an 
attribute name, again as shown by the topic-dependent 
semantic table, the programming-steps generator searches 
and identifies the attribute based on the noun. After all of the 
relevant attributes have been identified, data in them are 
retrieved for further processing by other parts of the question 
to generate an answer. 

If the noun denotes the data under an attribute, the 
programming-steps generator identifies the data, with its 
corresponding attribute and table. The instructions generated 
can be, for example, (1) identifying each table in the 
function Tables-Of({noun}); <2)foreach table identified, the 
function Attribute-Names({noun}, Table) returns the corre- 
sponding attributes containing the {noun} in that table: and 
(3) the remaining parts of the question operate on informa- 
tion under each attribute to generate the answer to the 
question. One set of instructions achieving such objectives 
is as follows: 



for Table in Tables- Oft {noun}) 
do 

for Attribute in Attribute- Names* {noun}. Table) 
do 



for Table in Table-Of( {proper noun}) 
do 

for Key in Keys-OffTable ) 
do 



endfor 

endfor. 



x = (SELECT . . . 
FROM Table 

WHERE Key MATCH {proper noun}) 
// The above clause has the meaning of ~wbere the key attribute 
// in the table matches the proper noun.** 
if x is valid then done 

// if the SELECT function successfully identifies one or more attributes. 
// x is valid. 



60 

Common nouns 

One grammatical component in the question can be a -continued 

common noun. The programming-steps generator might SELECT... 
transform the common n un into instructi ns to select a & FR0M Table 

topic-related table, an attribute name, a synonym of an where Attribute « {i 

attribute name, the data under an attribute, r an algorithm. 
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-c ntinued 
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endfor 



endfor 



The programming-steps generator might identify the 
algorithm corresponding to the noun; the algorithm is then 
applied to data selected by grammatical components in the 
question other than the common noun. 

Non- Auxiliary Verbs 

One grammatical component can be a non-auxiliary verb. 
It relates to one or more events or an action, which has a 
number of attributes; and it might have words with similar 
meaning. One approach is to identify the verbs with similar 
meaning. Then other components in the question identify 
data in the attributes of the identified verbs for answering the 
question. 

A verb can be related to many different events. As an 
example, the verb is "nominate": one event can be President 
Bush being nominated to be the President and another event 
can be President Clinton being nominated to be the Presi- 
dent. 

However, an event is related to a verb. The attributes of 
the event can have a subject-agent which is the agent 
performing the event, such as the party nominating the 
president. Typically, the preceding noun phrase before the 
verb identifies the subject-agent. The event can have an 
object-agent if the verb is a transitive verb, which is the 
agent acted upon by the event, such as the president being 
nominated. 

Each event has a duration that is between a starting and an 
ending time. For example, if the event is "walk** its duration 
starts with the sole of a foot changing its position from 
touching the ground to not touching the ground, and then 
ends with the sole back to touching the ground again. 

Non-auxiliary verbs are grouped together in an event 
table, which is a topic-related table, with the topic being 
events. The following is an example of an event in the table: 



10 



The selected verbs can be put into a temporary table or a 
view (a database terminology) as follows: 



CREATE VIEW Verb_View< { verb} ) As 

// View is a logical table that is created only when it is needed. 
// All events matching {verb} are grouped from the event table 
// to form the view. 
SELECT * FROM EVENT 

// here * denotes all of the attributes 
WHERE Synonym<{vcrb}> » Verb_word: 



The attributes of the selected verbs are also identified. Then, 
the programming-steps generator generates additional 
instructions based on other components in the question to 
identify data in the selected attributes for answering the 
question. 

Events might be related. Two events may form a sequen- 
tial relationship, where one event follows another event, 
such as eat and drink. Two events may form a consequential 

20 relationship, such as braking and stopping, with the braking 
event causing the stopping event. Many small events may 
make up a big event, with the big event containing the small 
events; this leads to containment relationships. Also, events 
may be related because they involve the same subject-agent; 

25 and events may be related because they involve the same 
object-agent. 

An event-relationship table describes relationships among 
events. It can have the following format: 



30 
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CREATE TABLE E VENTURE LATIONS HIP ( 

Keyldl Integer. // Keyld of an event 

Keyld2 Integer. // Keyld of another event 

Relationship Character String. 
//Relationship, such as sequential, consequential, containment etc. 

) 



Interrogative Pronouns 

Based on the interrogative pronoun in the question, the 
programming-steps generator generates one or more instruc- 



CREATE TABLE EVENT < 
Verb_word 

Subject_Agent 
Object_Ageni 

Sian_Time 
E«L_Tune 
Description 
Keyld 



Character String NOT NULL. 

// The verb that associates with the event 
Character String. // Agent name performing the event 
Character String. // Agent name acted upon by the 
//event 

Time. // Starting time of event 

Tune. // Ending time of event 

Character String. // Describes the event 

Integer. // Unique number identifying the event 



The subject-agent, object_agent etc. are attributes related 55 
to the verb__word, which is associated with an event 

There might be non-auxiliary verbs with similar meaning 
as the non-auxiliary verb in the questi n. These verbs can be 
identified by the synonym in the topic-independent semantic 
table. As an example, the v rbs of breathe and inhale have 60 
similar meaning. 

The programming-steps generator transforms the non- 
auxiliary verb in the question into one or more instructions, 
which select ne or more verbs with their attributes in the 
event table. The one or more verbs have similar meaning as 65 
the non-auxiliary verb. Then other components in the ques- 
tion identify data in the attributes f r answering the questi n. 



tions to select one or more attributes in one or more tables. 
Those tables have been selected by grammatical components 
in the question other than the interrogative pronoun. The 
function Attribute-Name({i-pronoun}, Table) generates the 
attribute name corresponding to the {i-pron un}. 

One way to generate a SQL-like instruction correspond- 
ing to the {i-pronoun} is to modify a SELECT clause: 

SELECT Attribute-Name({i-pronoun} t Table) FROM 
Table 

Determiners 

Examples f a set of semantic rules n determiners are: 
If the determiner is "a" or "an," select any result from the 
previous query. 



55 



60 
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If the determiner is "some." select more than one result executor executes them. The set may be generated from ne 

from the previous query If the previous query yields grammatical c mponem. This process repeats until all sets 

if * y h ' ^ "? * ff ,CCted - « g^nued and executed to mV question. For at 

tf * e .^™ 15 sdect 311 result ^ *e 1 ast one set of instruct! ns. the executor accesses data from 

a. • " .. -.^ , , . „ _ 5 one «■ more topic-related tables identified by the instruc- 

If to detenmnerjs -nhe/ moddy the foUowmg SELECT tions. In another embodiment, all the instructions are gen- 

£££ S?w ' * Sh ° WD by *« executor runs the instructiS, 

AuxiSary Verbs which mclude accessing data from one or more topic-related 

An auxiliary verb together with either its immediate noun l0 ^2^^E2?t £ nTaS— 

phrase or a non-auxiliary verb determine whether the answer question. natural language 

should be singular or plural Example 

Adjectives The following shows examples of instructions automati- 

One grammatical component of the question can be an cally generated to answer grammatically-context-free ques- 

adjective. Based on the adjective, the programming-steps 15 tions. 

generator either identifies the value of an attribute, or 

identifies an algorithm. The grammatical components in the 

question other than the adjective have already selected one m t ~" — — — — — — 

or more topic-related tables. i^^&SELu 

As shown by the topic-independent semantic table, the 20 *> 

adjective may identify an attribute. The function Attribute- for Attributcl Anribwc-Names(Pnesident Table) 

r^StS ^ * anribUtt * AMMMta. MM 

previously selected. The corresponding instruction can be: do 

res o (SELECT DISTINCT Attribute-Nan^ who. Table) 



FROM Table 

WHERE Attribute! * -PtesidenT 



for Attribute ia Attribute-Names({adjecuvc}. Table) " ORDER BY Attribute! ASC) 

do if (res u not empty) return (Bisi dement of results} 

SELECT... M .r eadfor 
FROM Tabk .. eadfor 

WHERE Attribute - {adjective} 30 H? # , . , M 

II or -Where the attribute in the table is equal to the adjective.- »^ (cnor. ik> solwion found} 



eadfor 



"VMM piU OK, U 

An adjective can refer to an algorithm, as identified by the 35 Hronoun, who 
topic-independent semantic table. Grammatical components 
in the question other than the component that is the adjective 



As clearly shown in this example, the analysis starts with the 
noun phrase, the first President, and works towards the 



have selected one or more topic-related tables. As shown in 1 What are the Bills of Right? 

the topic-independent semantic table, the adjective identifies ^ J*^*"* kTWI eUMnt 

one or more attributes in those tables. TbL the algorithm * Z™"^™**™*><* W> 
perates on one or more data in those attributes. for Key in Keys-OfiTabie) 

Preposition _ . 

r^l mmmnti ^ _ . . « ■ (SELECT Attribute-NamdwhaL Table) FROM TaWe 

One grammatical component can be a preposition. A where Key like -Bills of Right ): 



preposition can modify its previous noun phrase or verb, 45 aBSW€f a m$wcr f * 

such as by operating on them through an algorithm identified 
in the topic-independent semantic table. Under some 



situations, with one or more tables selected by at least one •* 

grammatical component in the question other than the rf ^« ^ not empty, return aruwer. othermse return 

component that is the preposition, the algorithm identified 50 As clearly shown in this example, the analysis starts with the 

operates on data or values in the one or more selected tables. noun phrase, the bills of rights, and work towards the 

Under some other situations, for example, due to the i -pronoun, what 

prepositions 'of and 'in', the programming-steps generator Ambiguous Questions 

processes the grammatical component succeeding the prepo- 55 ^ S rammatical structure analyzer may decide that the 
sition before the grammatical component preceding. natural-language question cannot be parsed into grammati- 
Fbr another example, the preposition 'before- can modify ~fP<»nents based on the pre-defined context-tree gram- 
me WHERE clause with a comparison on time: mancal structure. For xarnple, ttegrairimatical components 
, . , „ , ot tne question cannot fit into the pre-defined structure. Then 
(time of preceding eventWtime of succeeding vent) t»~ ;„ „ -a a ^ K»"«™" 
Prognunming-Steps Executor S ' » ^ quesuon is coiisidered ambiguous, and an answ r cannot 

The executor executes at least one se, of instructions aS^^T w r 

*» n ~r*t»A err™ " Ambiguity may be due to a number of reasons. For 

S^Z, ZdST? C ° mP ° IO * 1CaSt ""9* * e question may contain words with non-unique 
access iteta the database to generate an answer for the grammatical meaning, the question may contain words not 
quesuon, it mere is one. a ^ ^ g^n^^ ^ w ^ gnaao^ca { ^ 
In one embodiment, after the programnung-steps genera- question is different from the pre-defined grammatical solic- 
tor generates a set of instructions, the programming-steps tare. 
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The grammatical structure analyzer can decide thai a 
word can be f more than one g rammatical **>g*"»ing r such as < 
it can be a noun and a verb. In one embodiment, die analyzer 
produces an answer for each waning and ignores those 
meaning with no answer. In another embodiment, the ana- * 
lyzer asks the user to identify the correct grammatical 
meaning. 

If the grammatical structure analyzer decides that the 
question contains one or more words not in die grammatical 
table, in one embodiment, the analyzer removes the 10 
un-recognized word and processes the remaining words in 
die question. In another embodiment, die analyzer asks the 
user for a different word. The analyzer might assume that the 
word is mis-spelled, and ask the user to correct it; the l5 
analyzer might replace the un-recognized word with a word 
in the grammatical table most similar to or with minimum 
number of different characters from the un-recognized word. 
The analyzer then presents the matched word to die user to 
ask if that is the right word. A list of matched words may be 20 
presented for die user to select 

Also, die answer generator can present suggestions to the 
user on ways to rephrase the original question based on the 
noun and die non-auxiliary verbs. It would then be up to the 
user to select the one he wants. 25 
Questions Matching Engine 

Another embodiment of the answer generator provides 
answers even to non-natural-language questions, and 
grammatically-context-dependent questions. In this 
embodiment, the database includes a questions table, which 30 
contains many questions, each with its corresponding 
answer. A question matching engine compares the question 
entered with questions in die database. An answer retriever 
retrieves the answer to the question in the database that 35 
matches the entered question. If no question in the **atat?a$f 
matches the input question, the answer generator might use 
one of die approaches discussed in the ambiguous questions 
section to answer die question. 



